3D Modeling with Hand Gesture Interaction in a Semi-Immersive Environment

This paper presents an interactive 3D modeling system that realizes a new method for modeling 3D objects using non-instrumented hand gestures. Our model representation is based on a mesh library, which is optimized not only for real-time rendering, but also accommodates for changes of both vertex positions and mesh connectivity in real time. For performing the gesture interaction, the user’s hand is marked with just four fingertip-thimbles made of inexpensive material as simple as white paper. The recognized hand gestures are used to manipulate and deform the 3D meshes in a natural and intuitive way. With various modeling functions the modeler provides flexible modeling capabilities. The user’s viewpoints to see the modeling procedures are approximated by tracking a pair of marked polarized glasses. All modeling tasks are performed wirelessly through a camera/vision tracking method for the head and hand interaction. Figure 1. User interacts with a 3D virtual model by using non-instrumented hand gestures